Search for: All records

With the advent of multi-modal large language models (MLLMs), datasets used for visual question answering (VQA) and referring expression comprehension have seen a resurgence. However, the most popular datasets used to evaluate MLLMs are some of the earliest ones created, and they have many known problems, including extreme bias, spurious correlations, and an inability to permit fine-grained analysis. In this paper, we pioneer evaluating recent MLLMs (LLaVA 1.5, LLaVA-NeXT, BLIP2, InstructBLIP, GPT-4V, and GPT-4o) on datasets designed to address weaknesses in earlier ones. We assess three VQA datasets: 1) TDIUC, which permits fine-grained analysis on 12 question types; 2) TallyQA, which has simple and complex counting questions; and 3) DVQA, which requires optical character recognition for chart understanding. We also study VQDv1, a dataset that requires identifying all image regions that satisfy a given query. Our experiments reveal the weaknesses of many MLLMs that have not previously been reported. Our code is integrated into the widely used LAVIS framework for MLLM evaluation, enabling the rapid assessment of future MLLMs. 

Abstract Atmospheric rivers (ARs), intrusions of warm and moist air, can effectively drive weather extremes over the Arctic and trigger subsequent impact on sea ice and climate. What controls the observed multi-decadal Arctic AR trends remains unclear. Here, using multiple sources of observations and model experiments, we find that, contrary to the uniform positive trend in climate simulations, the observed Arctic AR frequency increases by twice as much over the Atlantic sector compared to the Pacific sector in 1981-2021. This discrepancy can be reconciled by the observed positive-to-negative phase shift of Interdecadal Pacific Oscillation (IPO) and the negative-to-positive phase shift of Atlantic Multidecadal Oscillation (AMO), which increase and reduce Arctic ARs over the Atlantic and Pacific sectors, respectively. Removing the influence of the IPO and AMO can reduce the projection uncertainties in near-future Arctic AR trends by about 24%, which is important for constraining projection of Arctic warming and the timing of an ice-free Arctic. 

Abstract The role of cloud feedbacks in Arctic amplification (AA) of anthropogenic warming remains unclear. Traditional feedback analysis diagnoses the net cloud feedback as strongly positive in the tropics but either weak or negative in the Arctic, suggesting that AA would be amplified if cloud feedbacks were suppressed. However, in cloud-locking experiments using the slab ocean version of the Energy Exascale Earth System Model (E3SM), we find that suppressing cloud feedbacks results in a substantial decrease in AA under greenhouse gas forcing. We show that the increase in AA from cloud feedbacks arises from two main mechanisms: 1) the additional energy contributed by positive cloud feedbacks in the tropics leads to increased poleward moist atmospheric heat transport (AHT) which then amplifies Arctic warming; and 2) the additional Arctic warming is amplified by positive noncloud feedbacks in the region, together making extrapolar cloud feedbacks amplify AA. We also find that cloud changes can modify the strength of noncloud feedback, but that modification has a small effect on Arctic warming. We further examine the role of cloud feedbacks in AA using a moist energy balance model, which demonstrates that interactions of cloud feedbacks with moist AHT and other positive feedbacks dominate the influence of clouds on the pattern of surface warming. However, the contribution of cloud-induced changes in noncloud feedbacks on AA is relatively minor. These results demonstrate that traditional attributions of AA, that are based on local feedback analysis, overlook key interactions between extrapolar cloud changes, poleward AHT, and noncloud feedbacks in the Arctic. 

Abstract As a dominant mode of jet variability on subseasonal time scales, the Southern Annular Mode (SAM) provides a window into how the atmosphere can produce internal oscillations on longer-than-synoptic time scales. While SAM’s existence can be explained by dry, purely barotropic theories, the time scale for its persistence and propagation is set by a lagged interaction between barotropic and baroclinic mechanisms, making the exact physical mechanisms challenging to identify and to simulate, even in latest generation models. By partitioning the eddy momentum flux convergence in MERRA-2 using an eddy–mean flow interaction framework, we demonstrate that diabatic processes (condensation and radiative heating) are the main contributors to SAM’s persistence in its stationary regime, as well as the key for preventing propagation in this regime. In SAM’s propagating regime, baroclinic and diabatic feedbacks also dominate the eddy–jet feedback. However, propagation is initiated by barotropic shifts in upper-level wave breaking and then sustained by a baroclinic response, leading to a roughly 60-day oscillation period. This barotropic propagation mechanism has been identified in dry, idealized models, but here we show evidence of this mechanism for the first time in reanalysis. The diabatic feedbacks on SAM are consistent with modulation of the storm-track latitude by SAM, altering the emission temperature and cloud cover over individual waves. Therefore, future attempts to improve the SAM time scale in models should focus on the storm-track location, as well as the roles of the cloud and moisture parameterizations. Significance StatementAs they circumnavigate the planet, the tropospheric jet streams slowly drift north and south over about 30 days, longer than the normal limit of weather prediction. Understanding the source of this “memory” could improve our knowledge of how the atmosphere organizes itself and our ability to make long-term forecasts. Current theories have identified several possible internal atmospheric interactions responsible for this memory. Yet most of the theories for understanding the jets’ behavior assume that this behavior is only weakly influenced by atmospheric water vapor. We show that this assumption is not enough to understand jet persistence. Instead, clouds and precipitation are more important contributors in reanalysis data than internal “dry” mechanisms to this memory of the Southern Hemisphere jet. 

Abstract For the Community Atmosphere Model version 6 (CAM6), an adjustment is needed to conserve dry air mass. This adjustment exposes an inconsistency in how CAM6’s energy budget incorporates water—in CAM6 water in the vapor phase has energy, but condensed phases of water do not. When water vapor condenses, only its latent energy is retained in the model, while its remaining internal, potential, and kinetic energy are lost. A global fixer is used in the default CAM6 model to maintain global energy conservation, but locally the energy tendency associated with water changing phase violates the divergence theorem. This error in energy tendency is intrinsically tied to the water vapor tendency, and reaches its highest values in regions of heavy rainfall, where the error can be as high as 40 W m −2 annually averaged. Several possible changes are outlined within this manuscript that would allow CAM6 to satisfy the divergence theorem locally. These fall into one of two categories: 1) modifying the surface flux to balance the local atmospheric energy tendency and 2) modifying the local atmospheric tendency to balance the surface plus top-of-atmosphere energy fluxes. To gauge which aspects of the simulated climate are most sensitive to this error, the simplest possible change—where condensed water still does not carry energy and a local energy fixer is used in place of the global one—is implemented within CAM6. Comparing this experiment with the default configuration of CAM6 reveals precipitation, particularly its variability, to be highly sensitive to the energy budget formulation. Significance Statement This study examines and explains spurious regional sources and sinks of energy in a widely used climate model. These energy errors result from not tracking energy associated with water after it transitions from the vapor phase to either liquid or ice. Instead, the model used a global fixer to offset the energy tendency related to the energy sources and sinks associated with condensed water species. We replace this global fixer with a local one to examine the model sensitivity to the regional energy error and find a large sensitivity in the simulated hydrologic cycle. This work suggests that the underlying thermodynamic assumptions in the model should be revisited to build confidence in the model-simulated regional-scale water and energy cycles. 

Abstract Models disagree on how much the hydrologic cycle could intensify under climate change. These changes are expected to scale with the Clausius-Clapeyron relation but may locally diverge due in part to the uncertain response of the general circulation, causing the hydrologic cycle to inherit this uncertainty. To identify how the circulation contributes, we link circulation changes to changes in the higher moments of the hydrologic cycle using the novel dynamical framework of the local hydrologic cycle, the portion of the hydrologic cycle driven by moist or dry intrusions. We expand this dynamical framework, developing a closed budget which diagnoses thermodynamic, advective, and overturning contributions to future hydrologic cycle changes. In analyzing these changes for the Community Earth System Model Large Ensemble, we show that overturning is the main dynamic contributor to the tropical and subtropical annual response, consistent with a weakening of this circulation. In the extratropics, we show that advective contributions, likely from storm track changes, dominate the response. We achieve a cleaner separation between dynamic and thermodynamic contributions through a semi-empirical scaling, which reveals the robustness of the Clausius-Clapeyron scaling for the local hydrologic cycle. This scaling also demonstrates the slowing of the local hydrologic cycle and how changing subtropical dynamics asymmetrically impact wave breaking and suppress meridional moisture transport. We conclude that dynamic changes in the subtropics are predominantly responsible for the annual, dynamic response in the extratropics and thus a significant contributor to uncertainty in future projections. 

Attributed network embedding aims to learn low dimensional node representations by combining both the network's topological structure and node attributes. Most of the existing methods either propagate the attributes over the network structure or learn the node representations by an encoder-decoder framework. However, propagation based methods tend to prefer network structure to node attributes, whereas encoder-decoder methods tend to ignore the longer connections beyond the immediate neighbors. In order to address these limitations while enjoying the best of the two worlds, we design cross fusion layers for unsupervised attributed network embedding. Specifically, we first construct two separate views to handle network structure and node attributes, and then design cross fusion layers to allow flexible information exchange and integration between the two views. The key design goals of the cross fusion layers are three-fold: 1) allowing critical information to be propagated along the network structure, 2) encoding the heterogeneity in the local neighborhood of each node during propagation, and 3) incorporating an additional node attribute channel so that the attribute information will not be overshadowed by the structure view. Extensive experiments on three datasets and three downstream tasks demonstrate the effectiveness of the proposed method. 

Silicon photonics has enabled large-scale production of integrated optical devices for a vast array of applications. However, extending its use to nonlinear devices is difficult since silicon does not exhibit an intrinsic second-order nonlinearity. While heterogeneous integration of strongly nonlinear materials is possible, it often requires additional procedures since these materials cannot be directly grown on silicon. On the other hand, CMOS-compatible materials often suffer from weaker nonlinearities, compromising efficiency. A promising alternative to current material platforms is scandium-doped aluminum nitride (Al1−xScxN), which maintains the CMOS compatibility of aluminum nitride (AlN) and has been used in electrical devices for its enhanced piezoelectricity. Here, we observe enhancement in optical second-order susceptibility (χ(2)) in CMOS-compatible Al1−xScxN thin films with varying Sc concentrations. For Al0.64Sc0.36N, the χ(2) component d33 is enhanced to 62.3 ± 5.6 pm/V, which is 12 times stronger than intrinsic AlN and twice as strong as lithium niobate. Increasing the Sc concentration enhances both χ(2) components, but loss increases with a higher Sc concentration as well, with Al0.64Sc0.36N exhibiting 17.2 dB/cm propagation loss at 1550 nm and Al0.80Sc0.20N exhibiting 8.2 dB/cm at 1550 nm. Since other material properties of this alloy are also affected by Sc, tuning the Sc concentration can balance strong nonlinearity, loss, and other factors depending on the needs of specific applications. As such, Al1−xScxN could facilitate low cost development of nonlinear integrated photonic devices.